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Abstract — We investigate tlie reasons behind the superior 
performance of belief propagation decoding of non-binary LDPC 
codes over their binary images when the transmission occurs over 
the binary erasure channel. We show that although decoding over 
the binary image has lower complexity, it has worse performance 
owing to its larger number of stopping sets relative to the 
original non-binary code. We propose a method to find redundant 
parity-checks of the binary image that eliminate these additional 
stopping sets, so that we achieve performance comparable to 
that of the original non-binary LDPC code with lower decoding 
complexity. 

L Introduction 

Low-density parity-check (LDPC) codes were introduced 
by Gallager |T| and rediscovered in the 1990's. Davey and 
MacKay showed that non-binaiy LDPC (NB-LDPC) codes 
perform better than binary codes for the same bit length |2|. 
Despite their better performance, higher decoding complexity 
has limited the implementation of non-binary LDPC codes 
in real- world applications. Reduced complexity decoding is 
possible using an equivalent binary Tanner graph, called the 
binary image of the code. There are many ways to construct 
binary images of non-binary codes - one way, referred to as 
basic binary image, is to represent each non-binary codeword 
by a binary vector of the same bit length. A recent result 
Q defines an extended binary image of longer bit length 
and establishes the equivalence of belief propagation (BP) 
decoding over it to BP decoding over the non-binary codes 
for the binary erasure channel (BEC). Based on this image, 
we compare NB-LDPC codes to their basic binary images 
and suggest an algorithm to find redundant parity-checks to 
improve the performance of the basic binary images. 

This paper is organized as follows. In Section |n] we briefly 
describe the BP decoding of NB-LDPC codes. We define 
the basic and extended binary images in Section 



III The 



superiority of BP over NB-LDPC code for BEC compared 



to its basic binary image is shown in Section IV and the 
algorithm to bridge this gap in performance through addition 
of redundant parity-checks to the basic binary image is given 
in Section |V] We summarize our findings in Section VI 



II. GF(2'')-LDPC Codes 

An LDPC code Cq over GF((7) where q = 2^ is specified 
by a parity-check matrix of dimension ruq x Uq whose 
elements are from GF((7), where the number of non-zero 
elements in is proportional to Uq. The code is then defined 
as the nullspace of H^, i.e., 

Cq = {Xe GF(g)"' : H, ®q = 0^} 



where X is assumed to be a row-vector, the all-zero row- 
vector, (X)g denotes matrix multiplication when matrix elements 
belong to GF(g), and ^ denotes transposition. When the 
parity-check matrix Hg is full-rank, the code Cq is a vector- 
subspace of GF{q)'^'' of dimension kq = Uq — niq, has a block- 
length Uq symbols, and is therefore of rate R= — = 1 — — . 

y 7lq flq 

We associate with the matrix a bipartite graph, called 
the Tanner graph Qq, as follows. Corresponding to the j* 
column of is a variable node Vj', and corresponding to 
the row is a check node C!^, i £ [niq] = {1,2,..., rriq}, j e 
[uq]. Every non-zero entry hij of Hg corresponds to an edge 
between Cf and Vj' with label hij. We denote by Af'"{j) the 
set of check nodes connected to a given variable node j G [uq], 
i.e., the neighbors of the j* variable node, and by M^{i) the set 
of variable nodes connected to a given check node i S [m^]. 
When the degree of every variable node and every check node 
in Qq is di and dr respectively, i.e., |A/'''(j)| = rf/, |A'''^(z)| = 
dr y i £ [mql.j £ [uq], the LDPC code Cq is said to be 
(d/, dr) -regular. It is easy to see that for a (d;, d^) -regular 
code, flie rate satisfies R = I - '-^ ^ I - f-. 

Belief Propagation Decoding 

The messages passed around on the Tanner graphs in the BP 
decoder represent the a posteriori probabilities of the symbols 
of GF((7). We will briefly describe the BP decoding of non- 
binary LDPC codes over the binary erasure channel (BEC) 
using the analogue of the peeling decoder, which for the BEC 
is the same as the BP decoder over Qq, which we denote as 
BP(H,). 

We assume a fixed isomorphism $b : GF(g) GF(2)'' 
that preserves the addition operation defined on GF(g). This 
isomorphism is used to map codewords X e Cg C GF{q)'"''' 
to binary vectors x £ GF(2)''"9. The vector x is transmitted 
over a BEC with erasure probability e and let £ be the index 
set of the erasures in the received word. At the receiver, the 
a priori set of eligible symbols 2^°'' for the variable node 
consists of symbols which fit the received binary sequence 
corresponding to the transmitted symbol. Thus 2^°' has 2" 
symbols if a out of the b bits in the received binary sequence 
corresponding to the j* transmitted symbol are erased. The 
peeling decoder updates these sets iteratively by exchanging 
messages between variable and check nodes. For the BEC, 
the messages passed around iteratively can be represented by 
sets of eligible symbols. Let Qfj denote the set of eligible 
symbols sent by the check node to the variable node 
in the iteration. Then, the peeling decoder performs the 
following steps iteratively for £ > 1 



Check node processing: For check node C"^ , i £ [rrig]. 



Q 



J2 Ki'Qr'^^ 



• Variable node processing: For variable node Vj ,j € [uq], 

where, if h e GF(q) and Q, Qi, Q2 C GF(q), we define 
hQ^{ha\a£ Q} 
Qi + Q2 = {ai + 02 1 ai e Qi, 02 e 22}- 

The decoder stops when {Q^'pl = \Qf~^^\y j G [nq]. 
Decoding is successful if | \ — 1 V j £ [riq] for some 
^ S N. It should be noted that any set of eligible symbols 
(Qj^'' or Q^j) is a coset of a vector subspace of GF(g) |j4j. 

III. Binary Images 

Since codes defined over GF(2'') can be written as a 
collection of vectors over GF(2), we can consider the binary 
images of these codes. Further, since BP decoding for GF((7) 
has a high computational complexity, we can make use of the 
binary images to decode the non-binary code. 

A. Basic Binary Image 

The isomorphism $ b defined in Section |ll] maps any row- 
vector of symbols X = {Xi, . . . , X^^) G GF(g)"'' to a binary 
row-vector ^b{X) = {^b{Xi), $5(^,1,)) of length bug. 
The basic binary image of Cq is defined as the set Cs C 
GF(2)''"<J where Cb = {*i3(^) : X e Cq}. As described 
earlier, the codewords of Cb are the ones that are transmitted 
over the BEC. Note that there are 

nLo (2'' - 2') possible 

choices for the isomorphism $5. 

Once fixed, the isomorphism ^ b identifies a mapping 'i'm : 
GF((7) 1-^ A4b, where Aii, is the collection of all invertible 
matrices over GF(2) of size b x b, defined below. For any 

h e GF{q), 



$S {h X (U2^fc)) 



where ^ denotes the binary row-vector of length b with the 
element « as 1 and other elements equal to 0, i.e., the unit vec- 
tor along the i* dimension. The set {5',„(/i) : h £ GF{q)} C 
Aih constitutes a field under matrix addition and matrix 
multiplication operations over GF(2), i.e., for /ii, /12 G GF((7), 

'i'mihl + h2) = ^'„^(/ll) ®2 *m(/l2) and *,„(/ll/l2) = 

^m(/ii) €52 ^m(h2)- Also, it is easy to see that for any 
h,x£ GF{q), 02 <^B{xy = ^B[hxy. 

The mappings $b and allow us to identify Cs as a 
linear block code with parity-check matrix H b that is obtained 
by replacing each element of by its image given by 
We could perform BP on the Tanner graph of Hs, denoted 



by BP(Hb), instead of the more complex BP(Hq). However 
this has worse performance in general due to the large number 
of short cycles introduced by \I>m(/i)'s in the parity-check 
matrix H^. In particular, for the BEC, we shall show later 
that this bad performance can be attributed to a larger number 
of stopping sets of H^. 

B. Extended Binary Image 

The observation made at the end of the previous subsection 
leads us to the question whether it is possible to design a bi- 
nary image of a non-binary code that matches the performance 
of the non-binary code. This question was answered in the 
affirmative by Savin in |^] for the BEC. We briefly describe 
the construction of this code, called the extended binary image. 

We define a mapping <^>E : GF{q) ^ GF(2)2 -1 such that 
each symbol of GF((7) is mapped to a codeword of the simplex 
code Cs{b) of length 2^ — 1, i.e., the dual of the Hamming 
code of blocklength 2^ - 1. For X e GF(g), 

^e{X)^^b{X) ®2 Gs{b) 

where Gs{b) is the generator matrix of the simplex code 
of size bx (2^-1). By linearity of $i3, <^e{Xi+ X2) = 
^EiXi) ®2 ^e{X2). Note that the columns of Gs{b) are all 
vectors of weight 1 < w < b. We will let the i* column of 
Gs{b) be (gi,i,52,j, ■ • ■,gb,zV where i = Ej=i5j,i2J-i for 
i e [2** — 1]. We use the mapping to map row -vector 
of symbols X = (Xi,...,X„J e GF(g)"' to a binary 
row-vector = ($£;(Xi), . . . , $£;(X„ J) of length 

{2^ — l)nq. The ordering of the columns of Gs{b) implies 
that for i G [uq], j e [b] 



($b(X,)), = ($b(X0)2.-i, 



(1) 



where we write {^B{X))e to denote the e* element of the 
vector representing ^b{X) for X G GF(g). The extended 
binary image of Cq is defined as the set Ce C GF(2)(^ -i)"? 
where Ce = {^e{20 ■ K G Cq}. For a fixed ^e, one can 
define a mapping ■ GF(g) 1-^ A^2''-i such that 

■^M{h) (8)2 ^E{Xy = <^>E{hXy y h,X e GF{q). 

Then the following can be shown. 

Lemma 1: 5'Af(^) is a permutation matrix for all h £ 
GF(g). 

The matrix UpM of dimension mq{2^ — 1) x nq{2^ — 1) is 
defined as one obtained by replacing each element of by 
its image under vPm- Then, the Tanner graph of Hpj\/ is a 
graph cover |(5l| of Qq with all edge labels equal to 1. It is 
easy to show that the extended binary image is 



Ce^{x£ GF(2) 



(2''-l)n, 



H 



PM ®2 X 



o"^}nCs(6)"' 



where 



Cs(6)"' - Cs{b) X ... X Cs(b) C GF(2)(2''-i)"«. 
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The overall parity-check matrix for the extended binary code 
is therefore of the form 



H 



E — 



HpM 

I„,0Hs(6) 



where is the {riq x Uq) identity matrix, H5(6) is the 
parity-check matrix of the simplex code and represents the 
Kronecker product. 

As a consequence of Equation ([T]i, transmitting the code- 
words of Cb amounts to transmitting bits indexed by the 
set It = {i e [(2'' - l)nq] : i = 2^ mod (2'' - 1), j G 
{0, 1, . . . , 6 — 1}} of the corresponding codewords in Ce and 
puncturing the rest. We will let Ip — [(2'' — l)nq] \ Xt denote 
the index set of punctured bits in Ce- For ease of notation, we 
will define ^ and ^ 

Example 2: Let us consider a code over GF(8) given by the 
following parity-check matrix = (a 1), where a is 

a primitive element of GF(8) with the primitive polynomial be- 
ing x^+x+\ = 0. The code may be represented as solutions to 
the following linear constraint aXi -\-a^X2+X^ = 0. Table |l] 

TABLE I 
■■ GF(8) 1-5- GF(2)3 

XgGF(8) 







(0,0,0) 
(0,0,1) 
(0,1,0) 
(1,0,0) 

(1,1,1) 

(1,1,0) 
(1,0,1) 
(0,1,1) 



gives the chosen mapping $b. Then the parity equations for 
the basic binary code can be written as 






(a;f 2 + 


+ ^2,2 " 




-0, 


(2) 




+ ^1,2 + 3) 


+ ^2,3 " 






(3) 




2^1,3) + (2^2,1 ~ 


y'X2^2) - 


3 


= 0. 


(4) 



The parity-check equation for the extended binary image can 
be written as 

^M{a)<^E{.Xi) + *M(a2)$B(X2) + *m(1)*£(^3) = 0. 

Thus, the seven binary parity-check equations represented by 
the equation above are represented by HpM given by 







yi'E\^2JJj 




i 
J 


1 2 3 4 5 6 7 


1 2 3 4 5 6 7 


1 2 3 4 5 6 7 


1 


I 


I 


I 


Pn 

^2 


1 


I 


I 


P3 


1 


1 


1 


Pi 


1 


1 


1 




1 


1 


1 


P6 


1 


1 


1 


P7 


1 


1 


1 



^E 
''2.2 



\ = which together 



Here, equation Pi is xfg 
with the simplex constraints xfg = xf 2 + xfg, x|'2 — ^22 
and be written as Equation (|2]). Similarly, 

equations P2 and P4 correspond to Equations (|3]l and Q re- 
spectively. Equations P3, P5, Pg, Pj are all linear combinations 
of the above equations. 

In 1 3 1, it was shown that the extended binary image was 
equivalent to the non-binary code from which it was con- 
structed. But this equivalence was established for the BEC 
with BP updates at the parity-check nodes and ML updates at 
the simplex nodes. In order to achieve this equivalence with 
BP, we will assume that the parity-check matrices represent- 
ing the simplex codes have redundant parity-checks assuring 
ML performance with BP. For the simplex codes, this is 
achieved by forming the parity-check matrix with rows of 
weight 3 ||6]. Hence, Hsib) is the parity-check matrix of 
size {2^ - l)(2''-i - 1) X (2'' - 1) for the simplex code. We 
will denote BP over the Tanner graph of with £15(6) 
having redundant checks and when only bits indexed by It 
are transmitted as BP(H£;). 

IV. Superiority of BP(Hq) over BP(Hi3) 

From the construction of the basic binary image and the 
extended binary image, it is clear that for each parity-check 
equation in H^, there are b parity-check equations in Hp and 
(2'' — 1) parity-check equations in the UpM portion of H^;. 

Lemma 3: For each row hq in the parity-check matrix Hg, 
the parity-check matrix H^; contains all non-trivial linear 
combinations of the b rows corresponding to in the parity- 
check matrix H^. 

Discussion: First, note that the extra variables in the ex- 
tended binary image were defined such that all non-trivial 
linear combinations of the transmitted bits were represented by 
a variable and these linear relations were maintained through 
the use of the simplex code for each non-binary symbol. 
Second, observe that by using the permutation matrices, we 
obtained a set of (2'' — 1) parity-check equations each involving 
exactly one of the variables from each simplex codeword. 
Putting these two together, we can show the above result. 

Since it is known that the performance of BP(Hg) is the 
same as that of BP(H£;), it suffices to show that BP(H£;) 
has superior performance in comparison with BP (Hp). The 
performance of codes over the BEC with BP decoding is 
determined by the stopping sets of the Tanner graph of their 
parity-check matrix |7|. By an erasure pattern £, we mean the 
index set of the erasures in a vector. For a binary parity-check 



3 



matrix H, let (3(11, £) denote the erasure pattern obtained at 
the end of decoding the received word with erasure pattern 
£ using BP on the Tanner graph of H. Then a stopping 
set is an erasure pattern £ such that /?(H,£) = £. Let 
S(H) = {£ : 13(11, £) = £} be the set of stopping sets of H. 
Notice that this condition is the same as the graph-theoretic 
requirement that every check node neighbor of variables in 
the Tanner graph of H indexed by £ be connected to these 
variables at least twice. However, with the extended binary 
image, we are interested in erasure patterns only among the 
transmitted variables. Hence we do not have a corresponding 
graph-theoretic definition of stopping sets of BP{He)- 

Definition 4 (Stopping Sets of BP (He))-' Consider BP de- 
coding of the extended binary code over the BEC with the 
parity-check matrix H^. A stopping set, £, is a subset of the 
index set of transmitted bits such that BP decoding can recover 
no transmitted bit in £, i.e., 

£ Cit such that /3(He, £Ulp)r]Xt= £. 

Discussion: Let us denote by Se the set of all stopping sets 
of the extended binary image as defined above. Let §(H£;) 
denote the set of all stopping sets of the code with parity- 
check matrix assuming all bits are transmitted. Define 

S'(llE) = {Snlt:S eHUe)}. 

Then, Sij = S*(H£;). This is because for each S e S^He), 
/3(H£;,5) is the maximal stopping set S' G §(H£;) such that 
S' nit = S. Note that for the basic binary image, the set of 
all stopping sets is just the normal definition Ss = §(Hb) 
since every bit of the basic binary image is transmitted. 

Proposition 5 fBP(H£;) better than BP(Hs);.- C §b. 
Proof: Suppose to the contrary that 3 S E E>e\^b- Then, 
there is a parity-check equation in that involves only one 
erasure, say xf^ = (^B(Xi))e- Let this equation be 

J2i^B(X,)), + 5] ^(<i>s(X,.)), = 

for some index sets Ii,Ifc C [b], V fc G 1,1 C [ug] \ {i} and 
e G li . We know from the construction of the extended binary 
image that there exist variables 

3 elk 

= ^($£;(Xfe))2,-i,fcGlU{i}. 

From Lemma |3] we also know that the equation 

a^^E.+E^fc.s, =0 (6) 

feGl 

is contained in UpM- Since every bit except xf^ was known 
in Equation (|5]), every bit except xf^^. is known in Equation 



(|6]l. Hence the extended binary image can solve for xf^,. But 
the simplex portion of H^; contains the equation 

=E<2.-=E('^^(^^))^■ 
which has only one unknown xf^^^i — xf^, which can also 
be solved for This is a contradiction to the assumption that 
5 gSb. Therefore, §£;\Sb =0. ■ 

Example 6: Consider the code in Example |2] and let the 
received word be (?0? 0?0 000), where ? denotes an erasure. 
It is easy to see that this received word corresponds to a 
stopping set of the basic binary image. However, the extended 
binary image can recover all erasures. Using Pg we can recover 
xfy, then using the simplex equation xf'y = X21 +xf2+^2 4 
we obtain X2 2- In turn, xf'j Vz G {1, . . . , 7} can be obtained. 
Finally we can use P3 and Pj to recover xf^ and xf 4. 

Note that although we have only shown improper contain- 
ment of §>E in the set of stopping sets of H^, in most cases 
this containment is proper, i.e., E}e C §>g. One case where 
Se — is when the Tanner graph corresponding to is 
cycle-free. 

Proposition |5] gives us an analytical insight into why non- 
binary codes perform well. However, since the superiority is 
established only in comparison with the basic binary image 
corresponding to the non-binary code, the result constitutes 
only a partial answer to why non-binary codes are better than 
their binary counterparts in general. 

V. Enhancing Cb using Redundant Parity-Checks 

It is known that the performance of a linear code over 
the BEC with BP can be improved by using a parity-check 
matrix with redundant parity-checks (RPCs). In fact, by adding 
enough parity-checks, we can guarantee ML performance with 
BP (See ||6) and references therein). A similar notion is that 
of stopping redundancy |f8l, where RPCs are added to remove 
stopping sets of size smaller than the minimum distance of 
the code. In the same spirit, we pose the question whether it 
is possible to achieve the performance of a non-binary code 
by its basic binary image with some RPCs. 

Proposition 7: For every S G §b\§£;, there exists an RPC 
for the basic binary image, hg ^2 ^b(20'^ = Q, such that 
S i §(Hb) where = (H]j|/iJ). 

Proof: Since S ^ §£, the BP decoder working over H^; 
can solve for some erased transmitted bit ^^2^-1 ~ "^f^e" 

This 

implies that the ML decoder working with can also solve 
for xfg. Since ML decoding over the BEC is the same as 
Gaussian elimination, the above means that there exists a linear 
combination of the parity-check equations in which has 
only xfg as the unknown, which can be set as /i^. ■ 
Note that since there might be multiple linear combinations 
of parity-check equations of that can solve for xf^, the 
RPC hg is not always unique. 

We now describe an algorithm that finds the RPC hg, 
pseudocode for which is given as Algorithm [T] Given 5, the 
algorithm starts the peeling decoding over H e with the erasure 
pattern 5UXp. The decoder maintains a list of all the punctured 
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Algorithm 1 Algorithm to find given S €Sb\^e 

n^d}, c^$, hs^o 

while 3 a row hf gHe that solves {^EiK))i do 
7^^7^U{(^,J)} 
it i Git then 

while £ 7^ do 



J n \ {i} do 



Let Ij C [(2'' 
for aU i' e 

Locate j') G 7?. 

push(/:,(*',j')) 
end for 

for all keljd It do 

(^k ^ l2J^\b+{k mod (2'' 



1)) 



ks 
end for 

end while 

return hg 

terminate 

end if 

end while 



ks 



bits that were solved and the unerased transmitted bits that 
were used to solve them. When a transmitted but erased bit 
is solved, the decoder is terminated and the algorithm finds 
an equation involving only this recovered transmitted bit and 
some unerased transmitted bits chosen based on the punctured 
bits that appear in the computation tree for this recovered 
transmitted bit. Thus, for a given stopping set, the algorithm 
uses a partial peeling decoding attempt over the extended 
binary image and a traversal through the computation tree of a 
recoverable transmitted bit to obtain the corresponding RFC of 
Hb- For a given collection of stopping sets, this algorithm is 
first run for low-weight stopping sets since RPCs that eliminate 
low-weight stopping sets may also eliminate higher weight 
stopping sets containing those low-weight stopping sets as 
a subset. It is possible to optimize the choice of RPCs to 
minimize the degrees of the additional check nodes introduced 
by them. However, this optimization was not considered in the 
implementation used for this paper. Note that the idea here is 
different from the one in |9J where the authors try to optimize 
the set of transmitted bits under the assumption that bits of 
the extended binary image indexed by a subset of Ip are also 
transmitted to obtain a lower rate code that performs better. 

Tables |ll] and |lll] list the number of codewords and number 
of stopping sets for two non-binary LDPC codes, C4 and Cg, 
and their binary images. Tanner graph for C4 is constructed 



randomly with parameters q = 2 



= 96, fc„ = 32, and 



di = 2,dr = 3. Tanner graph for Cg is constructed using 
Progressive Edge-Growth (PEG) |10) with parameters q = 
2^, Uq = 100, kg = 50, and d; = 2, — 4. Let Ag denote the 
number of codewords of weight w in the basic binary image 
Cb- Let §'"(H) denote the set of stopping sets of H of weight 



w, the set of stopping sets of the extended binary image 
of weight w. For C4, RPCs were added to its basic binary 
image to remove extra stopping sets of weights up to 12 in 
H.^ and weights up to 15 in while, for Cg, RPCs were 
added to remove extra stopping sets of weights up to 8 in 
and weights up to 10 in H]j°. The stopping sets Sib — ^(H-b) 
were found using the algorithm in | [TT| and whether these were 
in was verified by running the BP decoder over H^. For 
those stopping sets in Sb\§£;, the RPCs were found using the 
algorithm described earlier in this section. For C4, the basic 
binary image has 192 variable nodes and 128 check nodes, 
while the number of RPCs in and H]j^ are 93 and 154, 
respectively. For comparison, the extended binary image has 
288 variable nodes and 288 check nodes. Similarly, the basic 
binary image for Cs has 300 variable nodes and 150 check 
nodes, while the number of RPCs in and is 60 and 
185, respectively. The number of variable and check nodes in 
the extended binary image for Cs is 700 and 1050, respectively. 
In general, for a NB-LDPC code over GF((7), the number of 
variable and check nodes in the basic binary image is 0{logq) 
while it is 0{q) in the extended binary image. The number 
of variables nodes in the enhanced basic binary image is the 
same as basic binary image, while the number of check nodes 
is the sum of the number of check nodes in the basic binary 
image and the additional RPCs added. 

TABLE II 

Stopping set weights for a GF(4) code, C4, and its binary images 



w 






|S-(Hs)| 


|§»(Hi2)| 


|S»{Hi,^)| 


< 4 

















5 


4 


4 


6 


4 


4 


6 


2 


2 


11 


2 


2 


7 


7 


7 


31 


7 


7 


8 


7 


9 


50 


9 


9 


9 


3 


4 


86 


4 


4 


10 


12 


23 


171 


23 


23 


11 


22 


30 


343 


30 


30 


12 


63 


80 


873 


80 


80 


13 


87 


120 


2199 


151 


120 


14 


122 


204 


5463 


287 


204 


15 


205 


418 


13891 


650 


418 


16 


369 


793 


35209 


1322 


821 



TABLE III 

Stopping set weights for a GF(8) code, Cs, and its binary images 



w 


AW 
^B 




|§»(Hfl)| 


|S»(H|)| 


|§-(HiO)| 


< 2 

















3 








9 








4 

















5 

















6 


1 


1 


59 


1 


1 


7 


5 


5 


82 


5 


5 


8 


13 


13 


509 


13 


13 


9 


38 


38 


2781 


156 


38 


10 


64 


64 


11763 


612 


64 


11 


143 


147 


45310 


2102 


310 


12 


309 


358 


169120 


6363 


871 


13 


799 


970 


663617 


19346 


2575 


14 


1906 


2525 


2727519 


62032 


7893 



For the codes under consideration. Figures [T] and |2] plot the 
BP performance of the non-binary codes, their basic binary 
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images, and the enhanced binary images. The improvement in 
performance with RPCs is evident in the figures. The FERs 
of the non-binary code and the enhanced binary image are 
close to each other, and the corresponding BERs are also 
comparable. 




Fig. 1 . Bit (daslied curves) and frame (solid curves) en'or rates for the random 



non-binary code C4 witli pai'ameters q = 2 ,nq = 96, kq 
2,dr = 3 and its binary images considered in Table [n] 
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Fig. 2. Bit (dashed curves) and frame (solid curves) error rates for the PEG 
constructed non-binary code Cg with parameters q = 2'^,nq = 100, fcq = 
50, dj = 2, dr — 4 and its binary images considered in Table [iTl] 



VI. Conclusion 

We showed that when the transmission occurs over the 
BEC, BP decoding over the non-binary graph has a better 
performance than BP decoding over the Tanner graph of the 
basic binary image of the code. We proposed an algorithm to 
efficiently find effective redundant parity-checks for the basic 
binary image by observation of the BP decoding iterations 
of the extended binary image. Through numerical results and 
simulations, the effectiveness of the proposed algorithm was 
established. Obtaining bounds on the number of RPCs of the 
basic binary image needed to achieve the same performance 
as BP over non-binary code would be of interest. Similar 
characterization of the reasons for the superiority of non- 
binary codes over other channels involving errors as well as 
erasures will give further insight on designing strong codes 
and efficient decoding algorithms for such channels. 

VII. Acknowledgment 

This work was funded in part by NSF Grant CCF-0829865 
and by Western Digital. The authors would like to thank 
Xiaojie Zhang for help with simulations. 

References 

[1] R. G. Gallager, Low Density Parity Check Codes. Cambridge, Mas- 
sachusetts: MIT Press, 1963. 

[2] M. Davey and D. MacKay, "Low density parity check codes over 
GF{q)r in IEEE Inf. Theoty Workshop, Kilamey, Ireland, 22-26 Jun. 
1998, pp. 70 -71. 

[3] V. Savin, "Binary linear-time erasure decoding for non-binary LDPC 
codes," in 2009 IEEE Information Theon Workshop, Taormina, Italy, 
11-16 Oct. 2009. 

[4] V. Rathi and R. Urbanke, "Density evolution, thresholds and the stability 
condition for non-binary LDPC codes," lEE Proceedings on Communi- 
cations, vol. 152, no. 6, pp. 1069 - 1074, Dec. 2005. 

[5] T. Richardson and R. Urbanke, Modem Coding Theory. Cambridge 
University Press, 2008. 

[6] J. Han and P. Siegel, "On ML redundancy of codes," in Proc. IEEE Int. 
Symp. Inf. Theory, Toronto, ON, Canada, 6-11 Jul. 2008, pp. 280 -284. 

[7] C. Di, D. Proietti, I. Telatar, T. Richardson, and R. Urbanke, "Finite- 
length analysis of low-density parity-check codes on the binary erasure 
channel," IEEE Trans. Inf. Theory, vol. 48, no. 6, pp. 1570 -1579, Jun. 
2002. 

[8] M. Schwartz and A. Vardy, "On the stopping distance and the stopping 
redundancy of codes," IEEE Trans. Inf. Theory, vol. 52, no. 3, pp. 922 
-932, Mar. 2006. 

[9] L. P. Sy, V. Savin, and D. Declercq, "Extended non-binary low-density 
parity-check codes over erasure channels," CoRR, vol. abs/1 103.2691, 
2011. 

[10] X. -Y. Hu, E. Eleftheriou, and D. M. Arnold, "Regular and irregular pro- 
gressive edge-growth tanner graphs," IEEE Trans. Inf. Theory, vol. 51, 
no. 1, pp. 386 -398, Jan. 2005. 

[11] E. Rosnes and O. Ytrehus, "An efficient algorithm to find all small-size 
stopping sets of low-density parity-check matrices," IEEE Trans. Inf. 
Theory, vol. 55, no. 9, pp. 4167 ^178, Sep. 2009. 



6 



